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METHOD AND SYSTEM FOR PREDICTIVE PHYSIOLOGICAL GATING 



BACKGROUND AND SUMMARY 

5 The present invention relates to medical methods and systems. More particularly, 

the invention relates to a method and system for physiological gating. 

Many types of medical procedures involve devices and machines that act upon a 
particular portion of a patient body. For example, radiation therapy involves medical 
procedures that selectively expose certain areas of a human body, such as cancerous 

10 tumors, to high doses of radiation. The intent of the radiation therapy is to irradiate the 
targeted biological tissue such that the harmful tissue is destroyed. In certain types of 
radiotherapy, the irradiation volume can be restricted to the size and shape of the tumor or 
targeted tissue region to avoid inflicting unnecessary radiation damage to healthy tissue. 
Conformal therapy is a radiotherapy technique that is often employed to optimize dose 

1 5 distribution by conforming the treatment volume more closely to the targeted tumor. 

Other medical procedures are also directed to specific portions of a patient body. 
For example, radiation imaging typically directs radiation only to the portion of a patient 
body to be imaged. 3-dimensional imaging applications such as computed topography 
(CT), PET, and MRI scans also are directed to specific portions of a patient body. 

20 Normal physiological movement represents a limitation in the clinical planning 

and delivery of medical procedures to a patient body. Normal physiological movement, 
such as respiration or heart movement, can cause a positional movement of the body 
portion undergoing treatment, measurement, or imaging. With respect to radiation therapy, 
if the radiation beam has been shaped to conform the treatment volume to the exact 

25 dimensions of a tumor, then movement of that tumor during treatment could result in the 
radiation beam not being sufficiently sized or shaped to fully cover the targeted tumoral 
tissue. For imaging applications, normal physiological movement could result in blurred 
images or image artifacts. 

One approach to this problem involves physiological gating of the medical 

30 procedure, such as gating of a radiation beam during treatment, with the gating signal 
synchronized to the movement of the patient's body. In this approach, instruments are 
utilized to measure the physiological state and/or movement of the patient. Respiration 
has been shown to cause movements in the position of a lung tumor in a patient's body; if 
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radiotherapy is being applied to the lung tumor, then a temperature sensor, strain gauge, 
preumotactrograph, or optical imaging system can be utilized to measure the patient 
during a respiration cycle. These instruments can produce a signal indicative of the 
movement of the patient during the respiratory cycle. The radiation beam can be gated 
5 based upon certain threshold amplitude levels of the measured respiratory signal, such that 
the radiation heam is disengaged or stopped during particular time points in the respiration 
signal that correspond to excessive movement of the lung tumor. 

Many approaches to physiological gating are reactive, that is, these approaches 
utilize gating methods that slavishly react to measured levels of physiological movements. 

1 0 One drawback to reactive gating systems is that the measured physiological movement 
may involve motion that that is relatively fast when compared to reaction time of the 
imaging or therapy device that is being gated. Thus, a purely reactive gating system may 
not be able to react fast enough to effectively gate the applied radiation. For example, the 
gating system may include a switch or trigger for gating radiation which requires a given 

1 5 time period At to fully activate. If the delay period At is relatively long compared to the 
measured physiological motion cycle, then a system employing such a trigger in a reactive 
manner may not be able to effectively gate the radiation at appropriate time points to 
rninimize the effect of motion. 

Therefore, there is a need for a system and method to address these and other 

20 problems of the related art. There is a need for a method and system for physiological 
gating which is not purely reactive to measure physiological movement signals. 

The present invention provides an improved method and system for physiological 
gating. According to one embodiment, gating is performed based upon visual detection of 
patient motion relating to physiological activity. In an embodiment, an optical-based 

25 system is employed to measure and record physiological patient movement, in which a 
camera tracks and views the movement of a marker block or marker(s). A method and 
system is also disclosed for detecting and predictably estimating regular cycles of 
physiological activity or movements. Another aspect of an embodimentof the invention is 
directed to predictive actuation of gating system components. Yet another aspect of the 

3 0 invention is directed to physiological gating based upon the phase or non-periodicity of the 
physiological activity. The present invention can also be used to gate, either prospectively 
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or retrospectively, any type of procedure, including radiation therapy or imaging, other 
types of medical devices and procedures such as MRI, PET, SPECT, and CT scans. 

An embodiment of the invention also provides a system and method for position 
and motion monitoring including prompting the patient to hold breath and monitoring of 
5 the breath-hold state of the patient. In one embodiment, a patient positioning system 
comprises at least one camera, a marker block, and a computing device to compute the 
location and orientation of the marker block. The marker block preferably comprises a 
plurality of landmarks, e.g., retro-reflective markers. According to an embodiment, a 
method for identifying the position of a patient comprises the steps of first co-locating the 

10 marker block with a patient, viewing the marker block with at least one camera, producing 
image coordinates for the identified landmarks viewed by the camera, comparing the 
image coordinates with reference coordinates for the landmarks, and thereafter 
determining the position and orientation of the patient. 

Consistent patient positioning, either within the same device for different sessions, 

15 or between multiple devices, is facilitated using an optical-based positioning system, 
according to one embodiment of the present invention. Within the same device, the 
positioning system provides absolute position information for the patient that can be re- 
created during each treatment session. Between multiple devices, the optical-based 
positioning system establishes relative positioning information for the patient. The 

20 relative positioning information can be used to correctly conform the position of the 
patient between multiple devices. In one embodiment, a patient undergoes treatment 
planning at a first device during which an optical positioning system identifies a first 
relative position for the patient. Thereafter, the patient is controllably positioned to a 
therapy device, e.g., using a movable treatment table or in which the patient remains 

25 stationary but either the treatment planning or therapy device are moved in relation to the 
patient, e.g., on rails. The relative position of the patient to the therapy device is 
established and manipulated to conform to the desired treatment strategy. 

The present invention also provides a novel method and mechanism for 
implementing a physiological monitor, such as a respiration monitor. In one embodiment, 

30 a physiological monitor is implemented using an optical-based system in which a video 
camera records body movement relating to the physiological activity being monitored. 
The image data relating to the body movement is processed and displayed to represent the 
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physiological movement. The movement data can be analyzed and viewed to monitor the 
physiological activity. 

User interface inventions are disclosed for controlling and displaying motion, 
positioning, and gating information. In one embodiment, a circular interface is provides to 
5 control gating or treatment intervals based upon phase of physiological movement. 

Interface embodiments of the invention provide display and control for enabling/disabling 
gating and establishing gating thresholds. Additional interface embodiments display 
breath hold parameters and physiological motion range information. 

One embodiment of the invention provides a method and mechanism for video 

10 and/or audio prompting of patients to maintain desired physiological movement patterns. 
A disclosed embodiment employs a slider image that simultaneously displays visual 
feedback of the physiological movement as well as a desired range of the movement. For 
respiration activity, the slider comprises a movable slider bar that moves in response to a 
patient's inhale-exhale movements. This provides visual prompting and feedback 

15 regarding the respiration activity. In an embodiment, verbal prompting are employed to 
assist in controlling, maintaining, or manipulating the physiological activity of interest. 
For respiration activity, such verbal promptings could be computer-activated prompting to 
instruct a patient to breath in and breath out. 

These and other aspects, objects, and advantages of the invention are described 

20 below in the detailed description, drawings, and claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The accompanying drawings are included to provide a further understanding of the 
invention and, together with the Detailed Description, serve to explain the principles of the 
invention. 

Fig. 1 depicts the components of a system for physiological gating according to an 
embodiment of the invention. 

Fig. 2 depicts an example of a respiratory motion signal chart. 

Fig. 3 depicts a motion signal chart and a gating signal chart. 

Fig. 4 is a flowchart showing process actions performed in an embodiment of the 
invention. 

Fig. 5 is a flowchart showing process actions for detecting and predicting regular 
physiological movements. 

Fig. 6a depicts a side view an embodiment of a camera and ifluminator that can be 
utilized in the invention. 

Fig. 6b depicts a front view of the camera of Fig. 6a. 

Fig. 7a depicts a retro-reflective marker according to an embodiment of the 
invention. 

Fig. 7b depicts a cross-sectional view of the retro-reflective marker of Fig. 7a. 
Fig. 8 depicts an apparatus for making a retro-reflective marker. 
Fig. 9 depicts a phase chart synchronized with a gating signal chart. 
Fig. 10 depicts an embodiment of a hemispherical marker block. 
Fig. 1 1 depicts an embodiment of a cylindrical marker block. 
Fig. 12a depicts a system for physiological gating according to an embodiment of 
the invention. 

Fig. 12b illustrates an interface for viewing, controlling, and/br planning a gating 

plan. 

Fig. 13a shows a flowchart of a process for detecting periodicity or lack of 

periodicity according to an embodiment of the invention. 

Fig. 13b illustrates sample trains according to an embodiment of the invention. 

Fig. 13c is an example chart of showing phase and amplitude for a periodic signal. 

Fig. 13d shows an example of a periodic signal amplitude-phase histogram chart. 

Figs. 14a,14b, and 14c depict embodiments of a marker block. 

5 
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Fig. 15 shows a flowchart of a process for estimating position and orientation of a 

marker block according to an embodiment of the invention. 

Figs. 16 and 17 show embodiments of slider interfaces according to embodiments 

of the invention. 

Fig. 18 shows a system for positioning a patient among multiple devices according 
to an embodiment of the invention. 

Fig. 1 9 is a diagram of a computer hardware system with which the present 
invention can be implemented. 

Figs. 20-24 show interfaces for controlling, displaying, and plarming according to 
embodiments of the invention. 
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DETAILED DESCRIPTION 



An aspect of an embodiment of the present invention comprises a method for 
detecting and predictively estimating regular cycles of physiological activity or movement. 
5 Also disclosed are embodiments of systems and devices for patient positioning, 
positioning monitoring, motion monitoring, and physiological gating of medical 
procedures such as imaging and radiation therapy. The systems and methods of the 
mvention can be employed for any regular physiological activity, including for example, 
the respiratory or cardiac cycles, and for monitoring temporary breath-hold state of the 
10 patient. 

System for Patient Position Monitoring and Physiological Gating 

Fig. 1 depicts the components of an embodiment of a system 100 for physiological 
gating, position monitoring, and motion monitoring, in which data representative of 

1 5 physiological activity is collected with an optical imaging apparatus . For the purposes of 
illustration, system 100 is particularly described with reference to physiological gating of 
radiation therapy. Thus, system 100 comprises a radiation beam source 102 such as a 
conventional linear accelerator which is positionally configured to direct a radiation beam 
at a patient 106 located on treatment table 104. It is noted, however, that system 100 can 

20 also be applied to gate other medical procedures, such as gating for CT imaging 
applications or non-radioactive imaging applications such as MRI. 

In system 1 00 for physiological gating, a switch 1 1 6 is operatively coupled to the 
radiation beam source 102. Switch 1 16 can be operated to suspend the application of the 
radiation beam at patient 106. In an embodiment, switch 1 16 is part of the mechanical and 

25 electrical structure of radiation beam source 102. Alternatively, switch 116 comprises an 
external apparatus that is connected to the control electronics of radiation beam source 
102. Switch 116 may also comprise a software-based control mechanism. 

An optical or video image apparatus, such as video camera 108, is aimed such that 
at least part of the patient 106 is within the camera's field of view. Camera 108 monitors 

30 patient 1 06 for motion relating to the particular physiological activity being measured. By 
way of example, if respiration movements of the patient are being monitored, then camera 
1 08 is configured to monitor the motion of the patient's chest. According to an 
embodiment, camera 108 is placed on the ceiling, wall, or other support structure with its 
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axis tilted down between 20 and 70 degrees relative to the horizontal longitudinal axis of 
the patient 106. For measurement of respiration motion, the video image field of view is 
preferably set to view an approximately 30 cm by 30 cm area of the patient's chest. For 
purposes of illustration only, a single camera 108 is shown in Fig. 1. However, the 
5 number of cameras 108 employed in the present invention can exceed that number, and the 
exact number to be used in the invention depends upon the particular application to which 
it is directed. 

In an embodiment, one iUumination source per camera (which is an infrared source 
in the preferred embodiment) projects light at the patient 106 on treatment table 104. The 

10 generated light is reflected from one or more landmarks on the patient's body. The 

camera 108, which is directed at patient 106, captures and detects the reflected light from 
the one or more landmarks. The landmarks are selected based upon the physiological 
activity being studied. For respiration measurements, the landmarks are preferably located 
on one or more locations on the patient's chest. 

15 The output signals of camera 108 are sent to a computer 1 10 or other type of 

processing unit having the capability to receive video images. According to a particular 
embodiment, computer 1 10 comprises an Intel Pentium-based processor running 
Microsoft Windows NT or 2000 and includes a video frame grabber card having a 
separate channel for each video source utilized in the system. The images recorded by 

20 camera 108 are sent to computer 110 for processing. If camera 108 produces an analog 
output, the frame grabber converts the camera signals to a digital signal prior to processing 
by computer 110. Based upon the video signals received by computer 110, control signals 
can be sent from computer 110 to operate switch 116. 

According to one embodiment, one or more passive markers 1 14 are located on the 

25 patient in the area to be detected for movement. Each marker 1 14 preferably comprises a 
reflective or retro-reflective material that can reflect light, whether in the visible or 
invisible wavelengths. If the illumination source is co-located with camera 108, then 
marker 114 preferably comprises a retro-reflective material that reflects light mostly in the 
direction of the illumination source. Alternatively, each marker 114 comprises its own 

30 light source. The marker 1 14 is used in place of or in conjunction with physical landmarks 
on the patient's body that is imaged by the camera 108 to detect patient movement. 
Markers 114 are preferably used instead of body landmarks because such markers 1 14 can 
be detected and tracked more accurately via the video image generated by camera 108. 
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Because of the reflective or retro-reflective qualities of the preferred markers 1 14, the 
markers 1 14 inherently provide greater contrast in a video image to a light detecting 
apparatus such as camera 108, particularly when the camera 108 and illumination source 
are co-located. 

5 Utilizing a video or optical based system to track patient movement provides 

several advantages. First, a video or optical based system provides a reliable mechanism 
for repeating measurement results between uses on a given patient. Second, the method of 
the invention is noninvasive, and even if markers are used, no cables or connections must 
be made to the patient. Moreover, if the use of markers is impractical, the system can still 

10 be utilized without markers by performing measurements of physiological activity keyed 
to selected body landmarks. Finally, the method of the invention is more accurate because 
it is based upon absolute measurement of external anatomical physical movement. The 
present patient monitoring system is particularly suitable to track motion and position of 
patients for which intrusive/cumbersome equipment cannot or should not be used. For 

1 5 example, the present optical-based system is suitable for momtoring the movement and 
position of infants. 

A possible inefficiency in tracking the markers 1 14 is that the marker may appear 
anywhere on the video frame, and all of the image elements of the video frame may have 
to be examined to determine the location of the marker 114. Thus, in an embodiment, the 

20 initial determination of locations for the marker 114 involves an examination of all of the 
image elements in the video frame. If the video frame comprise 640 by 480 image 
elements, then all 307200 (640*480) image elements are initially examined to find Hie 
location of the markers 114. 

For real-time tracking of the marker 1 14, exarnining every image element for every 

25 video frame to determine the location of the marker 1 14 in real-time could consume a 

significant amount of system resources. Thus, in an embodiment, the real-time tracking of 
marker 1 14 can be facilitated by processing a small region of the video frame, referred to 
herein as a "tracking gate", that is placed based on estimation of the location of the 
already-identified marker 1 14 in a previous video frame. The previously determined 

30 location of a marker 1 14 defined in the previous video frame is used to define an initial 
search range (i.e., the tracking gate) for that same marker in real-time. The tracking gate 
is a relatively small portion of the video frame that, in one embodiment, is centered at the 
previous location of the marker 1 14. The tracking gate is expanded only if the tracking 
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algorithm can not locate the marker 1 14 within the gate. As an example, consider the 
situation when the previously determined location of a particular marker is image element 
(50,50) in a video frame. If the tracking gate is limited to a 50 by 50 area of the video 
frame, then the tracking gate for this example would comprise the image elements bound 
5 within the area defined by the coordinates (25,25), (25,75), (75,25), and (75,75). The 
other portions of the video frame are searched only if the marker 106 is not found within 
this tracking gate. 

The video image signals sent from camera 108 to computer 1 10 are used to 
generate and track motion signals representative of the movement of marker 114 and/or 

1 0 landmark structures on the patient's body. Fig. 2 depicts an example of a motion signal 
chart 200 for respiratory movement that contains information regarding the movement of 
marker 114 during a given measurement period. The horizontal axis represents points in 
time and the vertical axis represents the relative location or movement of the marker 1 14. 
According to an embodiment, the illustrated signal in Fig. 2 comprises a plurality of 

1 5 discrete data points plotted along the motion signal chart 200. 

Figs. 6a and 6b depict an embodiment of a camera 108 that can used in the present 
invention to optically or visually collect data representative of physiological movement. 
Camera 108 is a charge-couple device ("CCD") camera having one or more photoelectric 
cathodes and one or more CCD devices. A CCD device is a semiconductor device that 

20 can store charge in local areas, and upon appropriate control signals, transfers that charge 
to a readout point. When light photons from the scene to be imaged are focussed on the 
photoelectric cathodes, electrons are liberated in proportion to light intensity received at 
the camera. The electrons are captured in charge buckets located within the CCD device. 
The distribution of captured electrons in the charge buckets represents the image received 

25 at the camera. The CCD transfers these electrons to an analog-to-digital converter. The 
output of the analog-to-digital converter is sent to computer 410 to process the video 
image and to calculate the positions of the retro-reflective markers 406. According to an 
embodiment of the invention, camera 108 is a monochrome CCD camera having RS-170 
output and 640x480 pixel resolution. Alternatively, camera 408 can comprise a CCD 

30 camera having CCIR output and 756x567 pixel resolution. 

In a particular embodiment of the invention, an infra-red iUurninator 602 ("IR 

iUuminator") is co-located with camera 108. IR illuminator 602 produces one or more 

beams of infrared light that is directed in the same direction as camera 108. IR illuminator 
10 
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602 comprises a surface that is ringed around the lens 606 of camera body 608. The 
surface of JR illuminator 602 contains a plurality of individual LED elements 604 for 
producing infrared light. The LED elements 604 are organized as one or more circular or 
spiral patterns on the IR illuminator 602 surrounding the camera lens 606. Infrared filters 
5 that may be part of the camera 108 are removed or disabled to increase the camera's 
sensitivity to infrared light. 

According to an embodiment, digital video recordings of the patient in a session 
can be recorded via camera 108. The same camera 108 used for tracking patient 
movement can be used to record video images of the patient for future reference. A 

10 normal ambient light image sequence of the patient can be obtained in synchronization 
with the measured movement signals of markers 1 14. 

Figs. 7a and 7b depict an embodiment of a retro-reflective marker 700 that can be 
employed within the present invention. Retro-reflective marker 700 comprises a raised 
reflective surface 702 for reflecting light. Raised reflective surface 702 comprises a semi- 

1 5 spherical shap e such that light can be reflected regardless of the input angle of the light 
source. A flat surface 704 surrounds the raised reflective surface 702. The underside of 
flat surface 704 provides a mounting area to attach retro-reflective marker 700to particular 
locations on a patient's body. According to an embodiment, retro-reflective marker 700 is 
comprised of a retro-reflective material 3M#7610WS available from 3M Corporation. In 

20 an embodiment, marker 700 has a diameter of approximately .5 cm and a height of the 
highest point of raised reflective surface 702 of approximately .1 cm. Alternatively, a 
marker can comprise a circular, spherical, or cylindrical shape. 

Fig. 8 depicts an apparatus 802 that can be employed to manufacture retro- 
reflective markers 700. Apparatus 802 comprises a base portion 804 having an elastic ring 

25 806 affixed thereto. Elastic ring 806 is attached to bottom mold piece 808 having a bulge 
protruding from its center. A control lever 810 can be operated to move top portion 812 
along support rods 814. Top portion 812 comprises a spring-loaded top mold piece 814. 
Top mold piece 814 is formed with a semi-spherical cavity on its underside. In operation, 
a piece of retro-reflective material is placed on bottom mold piece 808. Control lever 810 

30 is operated to move top portion 812 towards base portion 804. The retro-reflective 

material is compressed and shaped between the bottom mold piece 808 and the top mold 
piece 814. The top mold piece 814 forms the upper exterior of the retro-reflective material 
into a semi-spherical shape. 

11 
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In an alternate embodiment, marker 1 14 comprises a marker block having one or 
more reference locations on its surface. Each reference location on the marker block 
preferably comprises a retro-reflective or reflective material that is detectable by an optical 
imaging apparatus, such as camera 108. 
5 According to one embodiment of the invention, physiological gating is performed 

by sensing physiological motion, e.g., respiration motion, using video tracking of retro- 
reflective markers attached to a marker block. One embodiment of the marker block 1471 
utilizes two markers 1473 and 1475 on a rigid hollow and light plastic block 1477 
measuring about 6 Cm X 4 Cm X 4 Cm as shown in Figure 14c. The two markers 1473 

10 and 1475 are preferably placed at a fixed distance of three centimeter on the side of the 
block that will face the tracking camera. The fixed distance between the two markers 1473 
and 1475 is known and is used to calibrate the motion of the block in the direction of the 
line connecting the two markers. 

According to one embodiment, the pixel coordinates of each marker in the video 

15 frame are tracked. The distance in the pixel domain between the two markers for each 
video frame is thereafter measured. The known physical distance of the two markers is 
divided by the measured distance to provide the scale factor for transforming the 
incremental motion of the block in the direction of the line connecting the two markers. 
This scale factor is updated for each new video frame and transforms the incremental 

20 motion of each marker from pixel domain to the physical domain. The transformation 
accounts for changes in the camera viewing angle, marker block orientation, and its 
distance to the camera during motion tracking. 

Fig. 1 1 depicts alternate embodiment of a marker block 1 1 00 having a cylindrical 
shape with multiple reference locations comprised of retro-reflective elements 1 102 

25 located on its surface. Marker block 1 100 can be formed as a rigid block (e.g., from 

plastic) . Blocks made in this fashion can be reused a plurality of times, even with multiple 
patients, e.g., if the normal hospital anti-infection procedures are followed. The retro- 
reflective elements 1 102 can be formed from the same material used to construct retro- 
reflective markers 1 14 of Figs. 7a and 7b. The marker block is preferably formed from a 

30 material that is light-weight enough not to interfere with normal breathing by the patient. 

A marker block can be formed into any shape or size, as long as the size, spacing, 

and positioning of the reference locations are configured such that a camera or other 

optical imaging apparatus can view and generate an image that accurately shows the 
12 
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positioning of the marker block. For example, Fig. 10 depicts an alternate marker block 
1000 having a hemispherical shape comprised of a plurality of retro-reflective elements 
1002 attached to its surface. 

The marker block can be formed with shapes to fit particular body parts. For 
5 example, molds or casts that match to specific locations on the body can be employed as 
marker blocks. Marker blocks shaped to fit certain areas of the body facilitate the 
repeatable placement of the marker blocks at particular locations on the patient. 
Alternatively, the marker blocks can be formed to fit certain fixtures that are attached to a 
patient's body. For example, a marker block can be formed within indentations and 
10 grooves that allow it to be attached to eyeglasses. In yet another embodiment, the fixtures 
are formed with integral marker block(s) having reflective or retro-reflective markers on 
them. 

An alternate embodiment of the marker block comprises only a single reference 
location/reflective element on its surface. This embodiment of the marker block is used in 

1 5 place of the retro-reflective marker 406 to detect particular locations on a patient's body 
with an optical imaging apparatus. 

Figs. 14a and 14b depict other embodiments of marker blocks 1402 and 1406 
usable in the invention. Marker block 1402 includes a rectangular shape having multiple 
reflective or retro-reflective marker elements 1404 located on it. Marker block 1402 

20 supports a rigidly mounted set of markers 14504 spread over an approximate volume of 
1 .5" X 3" X 4". The markers should appear as high contrast features in a real-time 
imaging device such as a video camera whose images are digitized and processed by a 
computer system. This realization of the marker block employs retro-reflective material 
covering a set of 0.25-inch diameter spheres glued or otherwise attached to a rigid plastic 

25 box or platform. Marker block 1406 includes a non-rectangular structure having multiple 
reflective or retro-reflective marker elements 1408 located on it. In an embodiment, the 
marker block is attached to the patient using standard hospital adhesive tape. In 
applications for which patient position and motion is monitored in multiple patient visits 
within a common set of reference coordinates, the marker block is preferably positioned 

30 for each visit at the same location, e.g., using two or more indelible marks on the patient 
skin. 

Patient position and motion can be monitored by optical tracking of a marker 
block, such as a marker block 1402 or 1406, attached to a patient chest, abdomen, back, or 
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other suitable patient location. In operation, a camera or video view of the marker block 
produces a set of image coordinates for the marker elements on the marker block. The 
position and distance of any marker element located on the marker block is known relative 
to other marker elements on the same marker block. By comparing the position and 
5 distance between the marker elements on a recorded image frame with the reference 

position and image stored for the monitoring system, the absolute position and orientation 
of the marker block can be estimated with a high degree of accuracy. This, in turn, 
provides an accurate position and orientation estimation for the patient or patient body 
position upon which the marker block is attached. Note that estimation of patient position 

1 0 and orientation can be performed in the invention using only a single marker block, rather 
requiring the placement of multiple markers on different parts of a patient's skin. 
Moreover, a single camera can be used to track the position of the marker block, rather 
than requiring triangulation using multiple cameras from different positions. 

Fig. 15 depicts a flowchart of a process for tracking a marker block (e.g., marker 

15 blocks shown in Figs. 14a or 14b) using a single camera according to an embodiment of 
the invention. At step 1502, the coordinates of the markers on the marker block are 
accurately surveyed in a coordinate system affixed to the marker block. This survey data 
is stored as reference data, and provides the known relative positioning and distances 
between markers on the marker block. At step 1504, the geometric calibration model of 

20 the overall imaging chain is obtained and stored. The parameters of this model relate the 
position of a point in 3-dimensional reference coordinates of the room or treatment area 
where the patient is located to the 2-dimensional image coordinates of the corresponding 
pixel in the digital image. This calibration model for both steps 1502 and 1504 can be 
derived offline, e.g., after the camera is mounted rigidly in the room, and is preferably 

25 repeated occasionally as a check. 

At step 1506, a new image frame is digitized from the camera video stream. At 
step 1508, an estimated position and orientation for the marker block is determined. The 
position and orientation of the marker block can be quantified in six degrees of freedom 
(DOF), e.g., x-coordinate, y-coordinate, z-coordinate, pitch, yaw, and roll. This estimated 

30 position and orientation is preferably using the same coordinate system affixed to the 

marker block and used for the survey of step 1502. This initial six DOF can be the 

approximate known marker block position and orientation, e.g., from the latest successful 

estimation of the marker block six DOF in a previous image frame in the video stream. 
14 
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At step 1509, the estimated marker block six DOF, the geometric cahbration model 
from step 1504, and the marker survey data from step 1502 are used to mathematically 
project the center of each marker and obtain an estimated pixel coordinates of each marker 
in the image frame. 

5 At step 1 5 1 0, the digitized image frame from step 1 506 is analyzed to detect and 

locate the markers in pixel coordinates. If the previous tracking was successful, use the 
projected centers of step 1509 to limit the search area for each marker to increase the 
computational efficiency. If processing the first image frame, or recovering from lost 
track, then the whole frame is analyzed to find and locate markers, tf three or more 

1 0 markers are found by the image analysis process, then proceed to Step 1512; otherwise, 
the process returns back to Step 1506 for a new image frame in the input video stream. In 
an embodiment of the invention, a subset of three or more markers should be visible to 
ensure a proper calculation of the six DOF coordinates for the marker block. However, 
this subset can vary from frame to frame in the input video stream. 

15 At step 1 5 1 2, the mathematically proj ected pixel coordinates are compared with 

the actual marker pixel coordinates. If the difference, e.g., measured in mean of squared 
distances in pixel domain, is below a threshold then the marker block six DOF (from step 
1508) is accepted as the final estimate of the marker block for the current image frame. 
The process then returns to step 1 506 for the next image frame in the video stream. 

J 

-' 20 If the difference between the mathematically proj ected pixel coordinates and the 

actual marker pixel coordinates exceed a defined threshold, then the procedure proceeds to 
step 1516 to estimate a new six DOF for the marker block. The new six DOF for the 
marker block is estimated based upon incremental changes to the assumed marker block 
six DOF that would result in a closer match between the mathematically projected points 

25 and the marker coordinates found in the actual digitized image. One approach for this 

estimation uses the Gauss method based on computing the inverse Jacobian matrix of pixel 
positions as a function of the six DOF parameters. The process uses this incremented 
marker block six DOF as the new assumed six DOF for the marker block and iterates by 
looping back to step 1512. 

30 While the process of Fig. 15 is usable with only a single camera, multiple cameras 

can also be used to expand the viewing volume of the patient monitoring system, or to 

allow continued operation of the system when the view of one camera is obstructed. 

When multiple cameras are used, the above process can be employed for each camera, 
15 
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independently, or triangulation of image data can alternatively be used to provide 
coordinates for the marker block. 

The output of the process of Fig. 15 comprises position and orientation data for the 
marker block that can be correlated to the position and orientation of a patient to which it 
5 is attached. Analysis of simultaneously recorded internal image data, e.g., fluoroscopic 
video, can also be used to confirm correlation of these externally attached markers with 
internal organ motion. Tracking of the marker block allows monitoring of the patient 
motion in diagnostic and therapy imaging applications where image data acquisition is 
gated or synchronized with periodic motion. It can also be used to monitor position in 

1 0 imaging or therapy machine coordinates for procedures that use the breath-hold method. 
As described in more detail below, the amplitude and/or phase of the marker block 
coordinates vs. time, corresponding to the motion and phase of patient physiological 
activity, can be used to trigger image acquisition or non-acquisition at specific points 
during normal periodic cycle (e.g., breathing cycle) to minimize image distortion effects of 

15 patient motion. The amplitude and/or phase can also be used to trigger treatment or non- 
treatment at specific points during the normal periodic movements. 

The marker block position can also be treated as a signal that is processed to detect 
deviations from periodic breathing such as those caused by coughing. This condition is 
used to stop image acquisition or delivery of radiation therapy to minimize the effects of 

20 unplanned motion. 

In addition, the instantaneous marker block position can be used as a respiration 
monitor signal. Rather than requiring cumbersome or intrusive devices to monitor 
respiration of a patient, the video approach of this embodiment of the invention provides a 
non-intrusive mechanism 1 to monitor patient respiration. The measured movement of the 

25 marker block can be used as an indicator of patient respiration. Thus, quantifiable values 
such as amplitude and/or phase of the marker block movement can be generated to 
monitor patient respiration. These values can be displayed and analyzed for breathing 
patterns using any conventional respiration analysis algorithms. 



Physiological Gating 

The following description of physiological gating applies to confrolling radiation 
in radiation therapy/imaging and to controlling the image acquisition process in imaging 
applications. Furthermore, the techniques are applicable to the breath-hold method of 
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therapy and imaging as well as gating in normal periodic breathing mode. For radiation 
procedures, e.g., X-ray radiotherapy and CT imaging, gating is performed by 
synchronizing the application of radiation to physiological activity such as patient motion. 
In emission imaging methods such as PET and MRI, the acquisition of data can be 
5 synchronized with patient motion so that the data coiresponding to a specific position or 
state of the patient is "binned" separately to minimize the effect of motion. 

To perform physiological gating according to an embodiment of the invention, one 
or more sets of data representative of the physiological activity of interest are collected for 
the patient in an embodiment of the invention. An optical-based system, such as system 

10 100 of Fig. 1 using marker(s) or a marker block, may be employed to generate data for 
physiological activity usable in the invention. 

One aspect of physiological gating is the determination of the boundaries of the 
treatment interval or interval range for applying radiation or gating data acquisition. For 
gating purposes, threshold points can be defined over the amplitude range of the motion 

15 signal to determine the boundaries of the treatment intervals. Motion of the external 
marker(s) that falls outside the boundaries of the treatment intervals correspond to 
movement that is predicted to cause unacceptable levels of movement. The external 
marker(s) motion is therefore accepted as a surrogate for the motion of internal anatomy 
and is thus used to control the imaging or therapy process. According to an embodiment, 

20 the treatment intervals correspond to the portion of the physiological cycle in which 
motion of the clinical target volume is minimized. Other factors for determining the 
boundaries of the treatment intervals include i<lentifying the portion of the motion signals 
mvolving the least movement of the target volume or the portion of the motion signal 
involving the largest separation of the target volume from organs at risk. Thus, the 

25 radiation beam pattern can be shaped with the minimum possible margin to account for 
patient movement. 

To illustrate with respect to radiation therapy, radiation is applied to the patient 
only when the motion signal is within the designated treatment intervals. Referring to Fig. 
3, depicted are examples of treatment intervals, indicated by signal range 302, which has 
30 been defined over the motion data shown in motion signal chart 200. In the example of 
Fig. 3, any movement of the measured body location mat exceeds the value of 0.4 (shown 
by upper boundary line 304) or which moves below the value of 0.0 (shown by lower 
boundary line 306) falls outside the boundaries of the treatment intervals. 
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Shown in Fig. 3 is an example of a gating signal chart 300 that is aligned with 
motion signal chart 200. Any motion signal that falls outside the treatment interval signal 
range 302 results in a "beam hold" gating signal threshold 310 that stops the application of 
radiation to the patient. Any motion signal that is within the treatment interval signal 
5 range 302 results in a "beam on" gating signal threshold 3 12 that allows radiation to be 
applied to the patient. In an embodiment, digital signals that represent the information 
shown in motion signal chart 200 are processed by computer 110 and compared to the 
threshold levels of the treatment interval signal range 302 to generate gating signal 
thresholds 310 and 312. Alternatively, gating signal thresholds 310 and 312 can be 

10 obtained by feeding analog motion signals to a comparator to be compared with analog 
threshold signals that correspond to treatment interval signal range 302. In any case, 
gating signal thresholds 3 10 and 3 12 are generated by computer 1 1 0 and are applied to the 
switch 116 that controls the operation of radiation beam source 102 (Fig. 1) to stop or start 
the application of a radiation beam at patient 106. 

15 Fig. 4 is a flowchart of the process actions performed in an embodiment of the 

invention. The first process action is to define boundaries for the treatment intervals over 
the range of motion signals to be detected by a camera (402). As indicated above, any 
motion that fall outside the boundaries of the treatment intervals correspond to motion that 
is predicted to result in unacceptable levels of movement of the tumor or tissue targeted 

20 for irradiation. An optical or video imaging system, such as a video camera, is used to 
measure the physiological motion of the patient (404), and the output signals of the optical 
or video imaging system are processed to compare the measured motion signals with the 
threshold boundaries of the treatment intervals (406). 

If the motion signal is outside the boundaries of the treatment intervals, then a 

25 "beam off gating signal threshold is applied to a switch that is operatively coupled to the 
radiation beam source (408). If the radiation beam source is presently irradiating the 
patient (410), then the switch setting is operated to hold or stop the radiation beam (41 1). 
The process then returns back to process action 406. 

If the motion signal is within the boundaries of the treatment intervals, then a 

30 "beam on" gating signal threshold is produced (412) and is applied to a switch that is 

operatively coupled to the radiation beam source. If the radiation beam source is presently 
not being applied to the patient (413), then the switch setting is operated to turn on or 
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apply the radiation beam source to irradiate the patient (414). The process then returns 
back to process action 406. 

According to one embodiment, the radiation beam source can be disengaged if a 
significant deviation is detected in the regular physiological movements of the patient. 
5 Such deviations can result from sudden movement or coughing by the patient. The 

position and/or orientation of the targeted tissue may unacceptably shift as a result of this 
deviation, even though the amplitude range of the motion signal still falls within the 
boundaries of the treatment intervals during this deviation. Thus, detection of such 
deviations helps define the appropriate time periods to gate the radiation treatment. 

10 The present invention can be applied to perform physiological gating of other 

medical procedures that are affected by patient movement, in addition to radiation therapy. 
For example, imaging procedures, such as CT, PET, and MRI scans, are subject to a range 
of image errors due to patient movement, including blurring, smearing, and the appearance 
of image artifacts. One or more treatment intervals or range intervals, e.g., as shown in 

1 5 Fig. 3, are established over the imaging cycle to gate the collection of image data from the 
patient. The treatment intervals define boundaries of physiological movement that is 
predicted to increase the likelihood of image errors. Motion within the boundaries of the 
treatment interval is predicted to correspond to fewer image errors. The treatment 
intervals are used to gate the application of radiation or acquisition of images from the 

20 patient using an imaging device. For example, during the "beam hold" portion of the 

treatment interval, the application of radiation for a CT system can be suspended. During 
the "beam, on" portion of the treatment interval, radiation is applied to the patient from the 
CT system to generate image data. Alternatively, gating can be performed by merely 
suspending the collection of data, even though the imaging device is still activated. For 

25 example, the CT system may still apply radiation to the patient through its entire cycle, but 
physiological gating is performed to suspend the recordation of data during the gating 
periods. 

In 3-dimensional imaging applications such as CT, PET and MRL the signal 
representing physiologically activity can also be used to retrospectively "gate" the 
30 reconstruction process. For this purpose, the acquisition of raw transmission or emission 
data is synchronized to a common time base with the physiological signal. Segments of 
the acquired raw data that correspond to movement cycle intervals of interest are used to 
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reconstruct the volumetric image thus minimizing the distortion and size changes caused 
by patient motion. 

One embodiment of the present invention provides a method for detecting and 
predictively estimating a period of a physiological activity. In effect, the present invention 
5 can "phase lock" to the physiological movement of the patient. Since the gating system 
phase locks to the movement period, deviations from that periodic signal can be identified 
and appropriately addressed. For example, when gating to the respiratory cycle, sudden 
movement or coughing by the patient can result in deviation from the detected period of 
the respiration cycle. If the invention is employed in a radiation therapy system, radiation 

10 treatment can be gated during these deviations from the regular period. Identifying these 
deviations from periodicity can also be used to gate other types of medical procedures, 
such as imaging application. The present invention also provides a method for 
predictively estimating the period of the subsequent physiological movement to follow. 
Fig. 5 is a process flowchart of an embodiment of the invention to perform 

1 5 predictive estimation and detection of regular physiological movement cycles. In process 
action 502, an instrument or system (such as system 100 from Fig. 1) is employed to 
generate data signals representative of the physiological activity of interest. In an 
embodiment, the data signals comprises a stream of digital data samples that collectively 
form a signal wave pattern representative of the physiological movement under 

20 examination. A number of discrete measurement samples are taken for the physiological 
activity during a given time period. For example, in an embodiment of the invention 
directed towards respiratory measurement, approximately 200-210 data samples are 
measured for each approximately 7 second time interval. 

In process action 504, pattern matching analysis is performed against the measured 

25 data samples. In an embodiment, the most recent set of data samples for the physiological 
signal is correlated against an immediately preceding set of data samples to determine the 
period and repetitiveness of the signal. An autocorrelation function can be employed to 
perform this pattern matching. For each new sample point of the physiological motion or 
physiological monitoring sensor signal, the process computes the autocorrelation function 

30 of the last n samples of the signal, where n corresponds to approximately 1.5 to 2 signal 
breathing periods. The secondary peak of the autocorrelation function is then identified to 
determine the period and repetitiveness of the signal. 



20 



WO 03/003796 PCT/US02/20304 

In an alternate embodiment, an absolute difference function is used instead of an 
autocorrelation function. Instead of secondary peak, a secondary minimum in the absolute 
difference is searched for. For each new sample point of the physiological motion or 
physiological monitoring sensor signal, the process computes the miiirmum absolute 
5 difference between the two sets of data over a range of overlapping data samples. The 
secondary minimum corresponds to the data position that best matches the recent set of 
data samples with the preceding set of data samples. 

Yet another alternate embodiment performs a pattern matching based upon a model 
of the physiological activity being measured. The model is a dynamic representation of 

10 the physiological motion or physiological monitoring sensor signal for that physiological 
activity. The latest set of data samples is matched against the model to estimate 
parameters of the repetitive process. 

Pattern matching using the measured physiological signal (504) provides 
information regarding the degree of match, as well as a location of best match for the 

15 repetitive process. If an autocorrelation function is employed in process action 504, then 
the relative strength of secondary peak provides a measure of how repetitive the signal is. 
A threshold range value is defined to provide indication of the degree of match between 
the two sets of data samples. If the strength of the secondary peak is within the defined 
threshold range (process action 508), then the degree of match indicates that the signal is 

20 repetitive, and the secondary peak location provides an estimate of the signal period. If an 
absolute difference function is used in process action 504, then the relative value of the 
secondary minimum provides a measure of how repetitive the signal is. If the value of the 
secondary minimum meets a defined threshold range (508), then the degree of match 
indicates that the signal is repetitive, and the secondary minimum location provides an 

25 estimate of the signal period. 

If the correlation value of the secondary peak or secondary minimum does not 
meet the defined threshold range, then a deviation from the regular physiological activity 
is detected, thereby indicating an irregularity in the regular physiological movement of the 
patient (510). This irregularity could result, for example, from sudden movement or 

30 coughing of the patient. In an embodiment, this detected irregularity results in the 

generation of a "beam hold" signal that suspends the application of radiation at the patient. 

If the degree of match indicates repetitiveness, the point of best match is tested to 

determine if the period is wilhin a reasonable range. The location of the secondary peak or 
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secondary minimum provides an estimate of the period of the physiological activity. In an 
embodiment, the point of best match is compared to a threshold range (509). If the point 
of best match does not fall within the threshold range, than a deviation from regular 
physiological activity is detected (510). If the point of best match falls within the 
5 threshold range, then the signal is accepted as being repetitive (512). 

The estimate of the period based on the point of best match can be used to predict 
the period and waveform parameters of the next set of data samples for the signal (514). 
Note that process actions 504, 508, and 509 test for repetitiveness based upon a plurality 
of data samples over a range of such samples. However, in some circumstances, a 

1 0 significant deviation from normal physiological movement may actually occur within the 
new or most recent data sample(s) being analyzed, but because the overall set of data 
samples indicates repetitiveness (e.g., because of averaging of absolute differences over 
the range of data samples being compared), process actions 504, 508, and 509 may not 
detect the deviation. To perform a test for rapid deviation, the predicted value from 

15 process action 514 is compared with the next corresponding data sample (515). If the 
predicted value does not match the actual data sample value within a defined threshold 
range, then deviation is detected (510). If a comparison of the predicted and actual data 
sample values fall within the defined threshold range, then repetitiveness is confirmed, and 
deviation is not detected for that data sample range (516). 

20 In an embodiment, the first time the process of Fig. 5 is performed, the pattern 

matching process action (504) is performed over the entire range of data samples. 
Thereafter, the pattern matching process action can be performed over a limited search 
interval, which is defined by the results of the prior immediate execution of the process. 
For example, the predicted value from process action 514 can be used to define the 

25 location of the search interval for the next set of data samples. However, if process action 
508, 509, and 514 detect deviation based upon analysis of the initial search interval, then 
the search interval can be expanded to ensure that a deviation has actually occurred. The 
process of Fig. 5 can be repeated with the increased search interval to attempt to find a 
point of best match outside of the initial search interval. In an embodiment, this increased 

30 search interval comprises the entire range of data samples. Alternatively, the increased 

search interval comprises only an expanded portion of the entire range of data samples. 

According to an embodiment of the invention, physiological gating can be 

performed based upon the phase of the physiological activity, rather than its amplitude. 
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This is in contrast to the example shown in Fig. 3, in which the amplitude of the 
physiological movement signal defines the boundaries of the treatment intervals for the 
application of radiation. 

Referring to Fig. 9, depicted is an example of a chart 900 showing the phase 
5 progression of a physiological movement signal. Treatment interval range 902 has been 
defined over the phase chart 900. In the example of Fig. 9, the boundaries of the treatment 
interval range 902 are defined by the phase of the detected signal. Radiation is applied to 
the patient only when the phase of the physiological movement signal falls within the 
boundaries of the treatment interval range 902. Fig. 9 depicts examples of treatment 

10 interval range 902 having boundaries that span from 30 degrees to 300 degrees. Thus, the 
applied radiation to the patient is suspended or stopped when the phase of the 
physiological movement signal is between 301 degrees to 29 degrees. 

Shown in Fig. 9 is a gating signal chart 906 that is aligned with phase chart 900. A 
"beam hold" signal threshold 910 results if the phase of the physiological movement 

1 5 signal falls outside the treatment interval range 902. A "beam on" signal threshold 912 
results if the phase of the physiological movement signal falls within the boundaries of the 
treatment interval range 902. The "beam on" and "beam hold" signal thresholds 910 and 
912 are applied to a switch 116 that operatively controls the operation of a radiation beam 
source 102 (Fig. 1). If radiation is being applied to the patient, application of the "beam 

20 hold" signal threshold 910 triggers switch 1 1 6 to suspend or stop the application of 
radiation. If radiation to the patient is not being applied, application of the "beam on" 
signal threshold 912 triggers the application of radiation to the patient. 

The predictive qualities of the present invention permits operation of a gating 
system even if the measured physiological movement involves motion that that is 

25 relatively fast when compared to the effectively operating speeds of gating system 

components. As just one example, consider a gating system that includes a switch for 
gating the radiation treatment, in which the switch requires a known time period At to fully 
engage. If the switching time period At is relatively slow compared to the measured 
physiological motion cycle, then a system employing such a switch in a reactive manner 

30 may not be able to effectively gate the application of radiation at the patient. 

The present invention allows predictive triggering of switch 1 16 to compensate for 
the amount of time At required to fully engage the switch. A predicted period for a 
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physiological activity can be obtained by employing the process of Fig. 5 . A treatment 
interval range is defined over a portion of the period of the physiological activity. Based 
upon the time At required to fully actuate the switch 1 16, the switch 116 can be pre- 
actaated by this time period At prior to the time of the boundary of the treatment interval, 
5 so that the time for full actuation of the switch 1 1 6 coincides with the boundary of the 
treatment interval. Thus, the radiation can be effectively gated at the boundaries of the 
treatment interval, regardless of the operating speeds of the switch 116. The same 
procedure can also be employed to compensate for the operating speeds of other gating 
system components. 

1 0 The following is an embodiment of the invention coded in the Visual Basic 

programming language. The following program code is directed to a process for detecting 
and predictively estimating the respiration cycle period using the absolute difference 
function: 

1 5 Public Function Predict(ByVal i As Long, ByVal Range As Long, Period As Double, 
MinAbsDiff As Double, Diff As Double) As Double 

Dim j As Long, StartJ As Long, CurrJ As Long 
Dim k As Long, MaxK As Long 
20 Dim AbsDiff As Double 

Dim NormAbsDiff As Double, n As Long 
k = Period -Range 
MinAbsDiff = 10000000# 

StartJ = TimeRefIdxBuf((i - 201 + BufLength) Mod BufLength) 
25 CurrJ = TimeReffdxBuf((i - 1 + BufLength) Mod BufLength) 
Do 
j = StartJ 
AbsDiff = 0# 
n = 0 
30 Do 

AbsDiff = AbsDiff + Abs(SigBuf(SigRefldxBuf(j)) - SigBuf(SigReffdxBuf((j + k + 
ChartWidth) Mod ChartWidth))) 
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n = n+l 

j = (j + 10) Mod ChartWidth 
Loop While n <= (200 - k) / 10 

NonnAbsDiff = 100 * AbsDiff / (n * Abs(MaxSigaal - MinSignal)) 
5 IfNormAbsDiff<=MinAbsDiffThen 

MinAbsDiff = NormAbsDiff 

MaxK = k 
End If 
k = k+l 

10 Loop While k <= Period + Range 

IfMaxK >= 40 And MaxK <= 150 Then Period = MaxK 

Predict = SigBuf(SigRefldxBuf((CurrJ - Period + ChartWidth) Mod ChartWidth)) 

Diff = 100 * Abs(SigBuf(SigRe£IdxBuf(CuirJ)) - Predict) / Abs(MaxSignal - MinSignal) 

If MinAbsDiff <= 20 Then 
1 5 ProgressBarl .Value = MinAbsDiff 

Else 

ProgressBarl .Value = 20 
End If 

End Function 

20 

In this program code, the variable "i" represents a counter or index to the data 
sample being processed. The variable "Range" represents the search range that is to be 
analyzed. If the period of the physiological cycle has already been determined (i.e., from a 
prior execution of this program code), then the variable "Period" comprises the detected 

25 period. If the period has not yet been determined, then the variable 'Teriod" is set to a 
default value representative of a normal respiration cycle (e.g., the number of data points 
in a normal breathing cycle, which is approximately 95 data samples in an embodiment of 
the invention where approximately 200-210 data samples are obtained over an 
approximately 7 second time period). The variable "MinAbsDiff' is the nnhimum 

30 absolute difference value over the search range. The variable "Diff' represents a 

comparison between the actual value of a next data sample and the expected value of that 
next data sample. 
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The variables "j", "Start J", and "CurrJ" are counters or indexes into the data 
samples being processed. The variable "k" is a counter to the search range. The variable 
"MaxK" represents the position in the search range having the minimum absolute 
difference value. The variable "AbsDiff" maintains the sum of the absolute difference 

-5 values for overlapping data samples. The variable "NormaAbsDiff ' is the average 

absolute difference value for a particular position in the search range, which is represented 
as a percentage value. The variable "n" is used to track the position of the data samples 
relative to the search range, which is represented as a percentage value. "Predict" is the 
predicted value that is returned by this program code. 

1 0 The variable "MinAbsDiff ' is initialized to a high value so that so that any 

subsequent absolute difference value will be smaller than the initialized value. In an 
embodiment, the set of data samples being processed comprises 200 data points. Thus, in 
this program code, the variable "StartJ" is initialized back 201 data samples. The variable 
"CurrJ" is initialized back one data sample. Because a circular array is being used, the 

15 "BufLength" variable is referenced during the initiaUzation of both "StartJ" and "CurrJ". 

The outer Do loop moves the current and preceding sets of data samples relative to 
each other. The outer Do loop is active while the variable "k" indicates that the program 
code is processing within the search range, hi an embodiment, the search range is initially 
set at three positions to either side of a predicted position. The predicted position is based 

20 upon the period obtained for an immediately prior execution of the program code. If the 
program code has not been executed immediately prior, then a default period value is 
used. If an acceptable nrinimum absolute difference value is not found within this search 
range, then the search range can be expanded to, for example, 50 positions to either side of 
the predicted position. 

25 The variable "j" is initialized to the "StartJ" value. The variables "AbsDiff and 

"n" are also initialized prior to execution of the inner Do loop. 

The inner Do loop performs the computation of the absolute difference values 
between the present set and prior set of data samples. The variable "AbsDiff ' maintains 
the sum of the absolute difference of values for overlapping data samples being compared. 

30 Note that the number of data samples being analyzed to deterrrrine the absolute difference 

values varies based upon the position in the search range being processed. This results 

because different positions in the search range have different numbers of data samples that 

overlap with the previous set of data samples being compared. In the embodiment of this 
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program code, the absolute difference function is computed using every 10 th signal sample 
point, i.e., a subsampled subtraction is used. Because a circular array is being used, the 
"Chartwidth" variable is referenced during the calculation of "AbsDiff '. 

The variables "MaxSignal" and "MinSignal" indicate a maximum and minimum 
5 range for signal values that have previously been sampled. These values can be 

established, for example, during a learning period for the system in which data samples are 
obtained for a plurality of respiratory cycles. The "NormAbsDiff ' variable holds the 
average absolute difference value represented as a percentage value based upon the 
'MaxSignal" and "MinSignal" values. 

10 If the "NormAbsDiff' value is less than or equal to a previously established 

'MinAbsDiff' value, then the "MinAbsDiff ' variable is set to the "NormAbsDiff' value. 
The "MaxK" variable is set to the value of "k" if the "MinAbsDiff' value is reset. The 
variable "k" is then incremented, and if the "k" value is still within the search range, then 
the program code returns back to the beginning of the outer Do loop. 

15 The result of this program code is a candidate minimum absolute difference value 

and a candidate position for the minimum absolute difference. The MaxK value is 
compared to pre-defined threshold values to ensure that it falls within a correct range of 
values for the physiological activity being processed. Thus, in an embodiment, the MaxK 
value is tested to make sure that it is greater than or equal to 40 and less than or equal to 

20 150. If the mark value meets the threshold range, then the variable "Period" is set to the 
"MaxK" value. The variable "Predict" returns the predicted value for the next set of data 
samples to be processed. The variable "Diff ' indicates the difference value between the 
current data sample value and the predicted data sample value, and is represented as a 
percentage to the "MaxSignal" and 'MixSignal" values. 

25 In an embodiment, an image of a progress bar can be displayed to visually indicate 

the periodicity of the signal samples. According to the program code, if the "MinAbsDiff' 
value is less than or equal to a 20% difference, then the visual progress bar is updated with 
the computed "MinAbsDiff' value. Otherwise, the visual progress bar displays all other 
"MinAbsDiff' values that exceed a 20% difference as a default value of "20". 

30 Fig. 13a shows a flowchart of an alternative approach for detecting deviation from 

periodicity of a physiological activity. For the purposes of illustration only, and not to 
limit the scope of the invention, the present explanation is made with respect to the 
periodicity of respiration activity. This process tracks the phase of a periodic signal, and 
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for each breathing signal sample, this approach provides an estimate of phase value 
indicating the breathing cycle phase for the patient. In the embodiment described here, the 
phase angles ranges from 0 to 2% (0 to 360 degrees) with 0 and 2it corresponding to the 
vicinity of inhale extreme of the respiration signal. Fig. 13c shows an example phase 
value chart 1350 for breathing signal samples superimposed on an example respiration 
amplitude signal 1352. 

The process of Fig. 13a receives a respiration data sample at step 1302. For each 
new sample of the respiration signal, the process obtains and updates estimates of the 
latest inhale and latest exhale extreme values and corresponding time points of the 
respiration signal. These values are used to establish the latest estimates of exhale period, 
inhale period, and therefore T, the overall period of breathing (1304). 

At step 1306, the process estimates the phase value of the newly acquired 
respiration signal sample. In an embodiment, this is performed by computing the inner 
product of a Cosine waveform with period T (estimated at step 1304) and the most recent 
T-seconds-long segment of the signal. This is repeated by computing the inner product 
with a Sine waveform of period T. These two inner products are called, respectively, the 
in-phase and quadrature components of the signal. The inverse Tangent of the result of 
dividing the quadrature value by the in-phase value provides the estimated phase for the 
current respiration signal sample. 

At step 1308, the process compares the vector, e.g., (amplitude, phase), of the 
current respiration sample with previous data sample values to determine periodicity of the 
signal. One approach to performing this comparison step is to use a two-dimensional 
histogram array of signal vs. phase value that is accumulated during prior recordings of the 
respiration signal. Fig. 13d shows an embodiment of a 2-dimensional histogram array 
1360 of amplitude-phase values. Histogram array 1360 is a 64 X 64 array of bins covering 
the 0 to 2tc phase in the horizontal dimension and the range of respiration signal amplitude 
in the vertical dimension. The amplitude and estimated phase of each new sample are used 
to increment the corresponding bin in histogram array 1360. 

In an embodiment, a clustering factor determines how close the current respiration 
data sample vector is to the cluster of values observed so far. By comparing the amplitude- 
phase vector of each signal sample with the cluster of prior values in its neighborhood, the 
process provides a measure of periodicity for the signal. The signal is considered periodic 
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for the current sample time when the clustering factor is above a defined threshold or 
tolerance level (13 14). Otherwise the signal is declared non-periodic (1312). One 
approach is to calculate the sum of the bin populations for the 8-amplitude x 5-phase 
surrounding bins for the current data sample. This population, as a percentage of the total 
5 population of all histogram bins accumulated so far, determines the degree to which the 
new sample belongs to a periodic signal. By applying a threshold to this percentage value, 
the signal sample is declared as periodic or non-periodic. This threshold value can be set 
by the user as the sensitivity of the algorithm for detecting deviations from periodicity. In 
the example of Fig. 13d, data sample set 1362 would presumably be declared as non- 
10 periodic since it substantially deviates from the general body of data sample values 1364, 
assuming that the values in data sample set 1362 cause the deterrnined percentage value to 
exceed a defined threshold. 

According to an embodiment, estimation of the inhale and exhale periods pursuant 
to step 1304 of Fig. 13a begins by identifying a starting assumption of these periods. If 
15 the process is at its very beginning, or is recovering from a loss of periodicity, then 

nominal or default values (such as inhale period =1.6 Sec and exhale period = 3.4 Sec) are 
used. The sum of these values is the current estimate of the physiological movement 
period. The approach of the present embodiment uses the most recent n samples of the 
signal to estimate the location and value of the minimum and maximum values, e.g., 
20 caused by breathing motion. One embodiment selects seven samples by sub-sampling the 
signal at intervals of l/20 th of the period. The choice of seven samples makes the 
computational load of the interpolation process manageable, while sub-sampling allows 
coverage of a larger portion of the signal thus avoiding false detection of local minima and 
maxima due to noise. For every new sensed signal sample (not sub-sampled) the n samples 
25 selected as described above are first validated to make sure their corresponding interval 
includes a minimum or a maximum. This is performed by comparing the absolute 
difference of the two end samples of the sample train with the average of the difference of 
the center sample and the two end samples. One embodiment uses the test: 
Abs(Y(0) - Y(6)) < 0.2 * Abs(Y(0) + Y(6) - 2 * Y(3)) 
30 to determine whether the sample train includes a minimum or a maximum. In this example 
the train of seven samples, Y(0), Y(l), Y(2), Y(3), Y(4), Y(5), Y(6), are sub-sampled at 
l/20 th of the of the number of samples constituting the current estimate of one period. If 
the result of this test is positive, curve fitting to the samples is performed. One 
29 
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embodiment fits a quadratic curve to the middle five points of the seven-point sample 
train. The location and value of the minimum or maximum value of this curve is computed 
using interpolation. Also at this point, it is determined whether the estimated point is a 
minimum or a maximum by comparing the end samples of the train with the middle 
5 sample. The estimated location of the minimum or maximum points are added to their 
respective accumulator variables for later averaging. 

The above process is repeated with the next sensed signal sample until the 
procedure encounters the first sample for which the above test result is negative. This is an 
indication that the run of points for which a minimum or maximum can be estimated has 

1 0 ended. At this point the accumulator variables are divided by the number of points in the 
run to obtain the average location and value from the run. 

The process continues by repeating the above test on the sample-train preceding 
every new sensed signal sample. Once the test result is positive the averaging process 
described above will start again. Figure 13b shows three examples of sample trains; 

15 sample train 1360 includes a local maximum; sample train 1362 includes a local 
minimum; and, sample train 1364 includes neither a maximum nor a minimum. 

This method estimates the local minimum or maximum location at a point in time 
that is later than the actual position of the extremum by the length of the sample train. The 
current estimate of the inhale or exhale period is updated at this point in time. For inhale 

20 period, for example, this is performed by subtracting the latest maximum position from the 
latest minimum position in time. These estimates are used to update the current value of 
the total period. 

The embodiments described herein provides a tool for measuring the periodicity of 
the respiration signal, thus allowing detection of deviation from normal physiological 

25 movement, e.g., deviation from normal breathing caused by a patient coughing or moving. 
This can be used during therapy, imaging, and interventional procedures that is facilitated 
or require monitoring of normal patient movement. In addition, the knowledge of the 
phase of the physiological activity allows predictive or prospective triggering of image 
acquisition or the onset of radiation therapy beam in situations where these systems 

3 0 respond after a known delay. 
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Planning Phase and Interface 

During the planning phase of the radiation treatment, gating simulations can be 
performed to determine the optimum boundaries of the treatment intervals. Fig. 12a 
depicts a system 1200 that can be employed to perform gating simulation. As with the 
5 system 100 shown in Fig. 1, system 1200 comprises a camera 108 that is directed at a 
patient on a treatment table 104. The output signals of camera 108 are sent to a computer 
1 10 for processing. System 1200 additionally includes an imaging system capable of 
generating images of internal structures within the patient's body. In an embodiment, 
system 1200 comprises a digital fluoroscopic imaging system having an x-ray source 1202 

10 and fluoroscopic x-ray detection apparatus 1204. The resulting fluoro video can be 
displayed on a fluoro display device 1206. In addition, the output signals from the 
fluoroscopic x-ray detection apparatus 1204 can be sent to the computer 110. 

During gating simulation, the movement of one or more landmarks or markers 114 
on the patient's body is optically measured using camera 108. The detected motion of the 

15 landmark or marker 114 results in the generation of motion signals according to the 
process discussed with reference to Fig. 2. While motion data is being collected, the 
fluoroscopic video system generates imaging data for the tumor or tissue that is targeted 
for irradiation. The present invention records the fluoroscopic image data and the marker 
motion data simultaneously on a common time base. In an embodiment, the positional 

20 geometry of the fluoroscopic imaging system is configured to correspond to the proj ection 
geometry of the radiation beam source that will be used in applying radiation beams for 
treatment. This allows accurate simulation of the target volume to be achieved during 
actual treatment. 

Fig. 12b depicts an embodiment of a user interface 1210 for presenting the 
25 recorded data of the fluoro images and motion signals. A portion of user interface 1210 
displays a chart 1212 of the measured motion signals. Another portion of user interface 
1210 displays internal image data, e.g., fluoro video 1214. During the planning phase of 
treatment, the fluoro video 1214 of the targeted body part or location, e.g., a tumor or in 
cases where the tumor is not visible in fluoroscope image another anatomical landmark 
30 whose motion is highly correlated with the tumor, can be displayed in synchronization 
with the display of the motion signals. Simultaneous display of both sets of data allow a 
visual manner of determining the proper boundaries of the treatment intervals, based upon 
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the range of movements of the targeted body part, location, tissue or tumor during 
particular portions of the motion signals. 

Gating simulations can be effected by performing "gated playback." Gated 
playback involves setting simulated threshold boundaries for the treatment intervals. 
5 During the gated playback, the user interface can be configured to only display the fluoro 
image when the motion signal is within the boundaries of the simulated treatment 
intervals. The fluoro video can be turned off or frozen if the motion signal is outside the 
simulated treatment intervals. The gating threshold can be dynamically adjusted while 
both the fluoro video and the motion signals are displayed in the user interface. The 

1 0 playback/adjustment procedure can be performed until the physician is satisfied with the 
gating thresholds of the treatment window. The display rate can be dynamically adjusted 
to speed or slow down the visual playback of the fluoro video. 

In an embodiment, a visual display border can be formed around region(s) of 
interest in the fluoro video 1214. For example, a box-like display border can be drawn 

15 around a tumor shown in fluoro video 1214. Alternatively, a display border generally 

matching the shape of a tumor can be drawn around that tumor. The visual display border 
can be used to simulate the shape of an applied radiation beam. During playback, the 
movement of the tumor in relation to the visual display border at particular points in the 
motion signal range can help determine the proper boundaries of the treatment intervals. 

20 The recorded fluoro image allows digital analysis and quantification of the amount 

of tumor motion resulting from regular physiological movement. For each image frame, 
the image data corresponding to the tumor or targeted tissue can be highlighted or 
otherwise selected by the computer 110. Calculations can be performed upon this image 
data to analyze motion of the tumor or tissue during the regular physiological movements. 

25 According to an embodiment, this analysis can be performed by edge detection and 

tracking. This applies to anatomic landmarks, such as the diaphragm supporting the lungs, 
which show an intensity edge in the fluoroscope images. The user designates an edge in a 
frame of the recorded fluoro segment. This could be done by drawing a line segment at or 
near the edge. Then, edge detection and localization is performed to determine the exact 

30 position of the edge to be found. The movie is then stepped to the next frame. In this new 
frame the position of the line segment corresponding to the edge location in the previous 
frame is used to find the edge again. This process is continued for the length of the 
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recorded fluoro segment. The edge position, and its rate of change, is used to select the 
optimum treatment interval. 

According to another embodiment, an area of the fluoroscope image is tracked 
from frame to frame using template matching. A template is selected in the first frame by 
5 drawing a box around the area of tumor or another landmark whose motion is correlated 
with tumor. This area under the box is used as a template that searched for in the next 
frame of the video segment. Since the extent of motion is limited at typical frame rates of 
10 or higher frames per second, the search area for template matching will also be limited. 
One embodiment of template matching uses two-dimensional cross correlation in which 

10 the position of the correlation peak is used to find the position of the template in the new 
image frame. Another embodiment uses minimum absolute difference of the template and 
candidate templates in the new image. Using the absolute difference approach, the 
position of the rninimum absolute difference will indicate the position of the template in 
the new frame. For both cross-correlation and minimum absolute difference embodiments, 

1 5 once matching template is found in the new frame, it is used as the template to be searched 
for in the subsequent image frame of the recoded video. The two-dimensional trajectory of 
the template position found in this way is then analyzed in order to determine optimum 
treatment intervals that correspond to least motion of specific range of positions of the 
tracked template. 

20 The quantified movement data of the targeted body part, location, tumor, or tissue 

allows precise determination of gating thresholds for the treatment intervals. For example, 
if the physician desires the treatment intervals to include periods of movements that will 
not exceed a certain threshold movement margin, then the quantified movement data can 
be analyzed to determine the exact boundaries of the treatment intervals that achieves the 

25 desired movement margin. Alternatively, certain preset movement margin thresholds can 
be programmed into the computer 1 10. Based upon the preset movement margins, the 
system can perform an analysis of the movement data to determine the optimal gating 
thresholds of the treatment intervals to achieve the preset movement margins. This gating 
threshold can be designated as the default or suggested treatment intervals for the 

30 corresponding patient. 

Verification can be performed to validate the gating threshold settings of the 

treatment intervals. This is particularly useful during delivery of fractionated treatment. 

This can be done by gated verification imaging performed during a treatment session with 
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the radiation beam source. Gated electronic portal images can be obtained during delivery 
of the fractionated radiation treatments. To accomplish this, the gating system triggers a 
single exposure or a sequence of exposures which can be visually or automatically 
compared to the original reference images. The verification can be repeated at any point 
5 deemed clinically appropriate during the treatment schedule. 

Patient Positioning 

The position and motion monitoring system 100 can also be used to position the 
patient accurately in imaging and therapy applications involving multiple patient visits to a 

10 medical device, system, or room. During patient setup, the position and orientation of the 
marker block is recorded. By placing a marker block at the same position on the patient 
skin in each session, its 3-dimensional position in room or machine isocenter coordinates 
is an accurate representation of the patient position. At a subsequent session, the position 
of the patient is adjusted until the marker block is consistent with the recorded position 

15 and orientation. 

Fig. 1 8 illustrates how the invention can be used to position a patient 106 among 
multiple medical devices. For the purposes of illustration, consider a common scenario for 
performing radiation therapy. A first phase of radiation therapy is a setup or treatment 
planning operation that consists of performing scanning or imaging procedures upon the 

20 patient to accurately locate and define the area of the patient body to be treated, e.g., using 
CT, MRI, SPECT, or PET procedures. The image data is used to develop a radiation 
treatment plan. The treatment plan often comprises the dosage level and treatment volume 
of radiotherapy to apply to the patient. The treatment planning phase may also comprise a 
simulation procedure to verify the appropriateness of the treatment plan. Once the 

25 treatment plan is developed, the second phase involves moving the patient to a radiation 
therapy device to implement the treatment plan. To optimize this procedure, the patient's 
relative position to the radiation therapy device should be consistent relative to the 
patient's imaging position for the image data used to develop the treatment plan. 

According to an embodiment of the invention, the optical position and motion 

30 monitoring system of the present invention is usable to accurately and consistently 

position a patient among multiple medical devices. Shown in Fig. 1 8 is a patient 1 06 co- 
located with a marker block 114. During setup operations, the patient is scanned or 
imaged using an imaging device, such as MRI device 1802 or a CT system. During patient 
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setup, a first video camera 108a provides images of me patient to record the position and 
orientation of the marker block 1 14. The 3-dimensional position or machine isocenter 
coordinates of the marker block 1 14 for the imaging session at the MRI device 1802 is 
stored as reference data. 
5 During the subsequent treatment session, the patient 1 06 is moved to a radiation 

therapy device 1804. In an embodiment, the treatment table 104 upon which the patient 
106 is resting is configured such that it can be moved between the MRI device 1802 and 
the radiation therapy device 1804. This can be accomplished, for example, by movably 
attaching the treatment table 1 04 to floor rails 1 806. Moving the entire treatment table 

10 1 04 to move the patient 106 between medical devices, rather than moving just the patient 
106, reduces the chance that internal organs within the patient will shift during movement. 

Because the geometry of the first camera 108a to the MRI device 1802 is known, 
and the geometry of the second video camera 108b to the radiation therapy device 1804 is 
also known, it is possible to translate the relative position of the patient during the imaging 

1 5 session before the MRI device 1 802 into a corresponding relative position at the radiation 
therapy device 1 804. This corresponding relative position is the desired position at the 
radiation therapy device 1804 to maximize the efficacy of the treatment plan developed 
based upon imaging geometry at the MRI device 1802. 

When the treatment table 104 is moved to the radiation therapy device 1804, a 

20 second video camera 108b provides images of the patient 106 that is used to calculate the 
3-dimensional position or machine isocenter coordinates of the marker block 1 14. 
Because the desired patient/marker block location is known, the patient 106 or treatment 
table 104 can be shifted until the marker block is consistent with desired position and 
orientation. 

25 During patient positioning, the therapist can monitor patient position in real time 

using indicators such as the slider interface 1600 shown in Fig. 16. Each slider in interface 
1600 shows position in a specific dimension relative to the reference session. The slider 
element 1610 in slider 1602 tracks motion of the patient in the anterior/posterior- 
posterior/anterior dimension. Slider 1604 tracks the lateral movement of the patient. 

30 Slider 1606 tracks the Superior-Inferior movement of the patient. The exact positions of 
slider elements in interface 1600 are recorded during patient setup. To perform patient 
positioning, the position of the patient is adjusted until the slider bars are consistent with 
the measured positions of the slider elements from the setup phase. When a patient is 
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surveyed during setup, the slider positions representing the patient coordinates are 
recorded. Each slider can be configured to show the expected range of respiration motion 
as a reference interval, which is shown in interface 1600 as a black bar within each slider 
1602, 1604, and 1606. For example, black bar 1608 shows the normal expected range of 
5 motion for the slider element 1 6 10 in slider 1602 



Patient Feedback and Breath Hold 

According to an embodiment of the invention, a real time position indicator display 
is provided that can also serve as patient visual feedback for both regulating and limiting 

10 the breathing motion in normal breathing mode. The position indicator display is also 
usable for positive cooperation by patient in breath-hold mode of imaging and 
interventional procedures. 

Medical procedures in which a patient may be instructed to hold breath include 
image acquisition procedures and interventional procedures such as biopsy needle 

15 insertion. Typically, several breath holds separated by normal patient breathing are 
usually required to complete the image acquisition or delivery of radiation dose for 
therapy. In conventional breath hold applications, it is extremely difficult for a patient to 
maintain a consistent position from one breath hold to another breath hold. This difficulty 
arises because the patient cannot precisely determine the exact point to consistently hold 

20 breath from one instance to another. Thus, it is possible that the volume or position of a 
patient's chest/abdomen differs from one breath hold to another. 

As noted above, the optical monitoring system of Fig. 1 can be used to quantify the 
position and orientation of a patient position corresponding to a marker block or a set of 
markers. Thus, the position and offset of movement by a patient during breath hold can be 

25 quantified. By quantifying these values during breath hold, the patient position during 
breath hold can be reliably and consistently repeated. 

Fig. 17 shows one embodiment of a real time position indicator 1700 using a slider 
that is displayed to the patient on a computer display. The slider position 1702 shows, for 
example, the up-down chest position for a horizontal patient setup. During exhale, the 

30 slider position 1702 moves up and during inhale, the slider position 1702 moves down. 
The expected range of positions, e.g., for breath holding is shown as an interval 1704. 

The patient is instructed to try and maintain the position of the slider bar 1702 
within the boundaries of the indicated range 1704, where the position and width of this 
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range of motion is selected according to what the patient could comfortably achieve in the 
planning session. In an embodiment, the visual feedback tool is also used to encourage the 
patient to breathe more shallowly than he or she normally would. Verbal prompting and 
feedback can also be provided to the patient to influence a more consistent physiological 
5 pattern. For example, an audio message "breathe in" can be performed to prompt a patient 
during a desired inhale period. An audio message "breathe out" can be performed to 
prompt a patient during a desired exhale period. An audio message "hold breath" can be 
performed to prompt a patient during a desired breath hold period. 

The interface of Fig. 16 can also be used to graphically quantify the patient breath 

1 0 hold position. An indicator range can be placed in one or more of the sliders in interface 
1600 at a desired breath hold position. To recreate that breath hold position, the patient is 
instructed to hold breath until the slider bars within the appropriate sliders correspond to 
the marker position on the sliders. For imaging applications, the onset of image acquisition 
for each breath hold is triggered when marker block position enters the range 

1 5 corresponding to breath-hold, and is automatically stopped when the patient relaxes and 
marker block exits the breath hold range. This makes the breath hold imaging mode more 
accurate and robust because without such position monitoring capability the patient breath 
hold position can change from breath-hold to breath-hold. 



20 Interface Controls 

Fig. 20 displays an indicator display 2000 for controlling and displaying motion 
and gating information. Display 2000 comprises a graphical signal chart 2002 that tracks 
the physiological movement of the patient, e.g., by tracking the motion of a marker block. 
A phase display portion 2004 includes a moving display bar 2006 that tracks the phase of 

25 the physiological movement. If gating based upon phase is employed, then the gating 
range or non-gating range can be controlled by defining a treatment window 2008 in the 
phase display portion 2004. The treatment window 2008 is defined to extend from a first 
phase value to a second phase value within the phase display portion 2004. Alternatively, 
gating can be implemented by defining treatment intervals 2010 over the amplitude signal 

30 chart 2002 of the physiological movement. 

To provide visual prompting for a patient, a desired movement window 2012 is 
displayed over the signal chart 2002. During the exhale period, the patient is instructed to 
try and maintain the position of the signal chart 2002 within the lower boundaries of the 
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indicated range for the movement window 2012. During the inhale period, the patient is 
instructed to try and maintain the position of the signal chart 2002 within the upper 
boundaries of the movement window 2012. 

Fig, 21 shows an interface window for controlling a CT gating and monitoring 
5 system. A control portion 2102 is used to turn on or off CT gating. The control portion 
2106 sets a threshold value for detennining deviation from periodicity of the breathing 
cycle, e.g., as used for the process of Fig. 13a. The control portion 2108 detenrrines 
whether gating is performed based upon either amplitude or phase. The control portion 
2104 allows entry of the known or estimated CT scanner delay and scan length parameters 

10 for the CT scanners that do not have a feedback interface for automatic sensing of these 
parameters. These parameters are used to show the best estimate of the CT scan period on 
the breathing chart. In an embodiment of the invention the portion of breathing chart 
corresponding to the CT scan period is drawn in color green. For example in a therapy 
application this allows selection of gating thresholds that result in the best match of the 

1 5 beam-on period and the CT image acquisition interval, i.e., the user tries to match the 
beam-on period with the green portions of the breathing chart. 

Fig. 22 shows an interface window for controlling patient prompting and feedback. 
Control portion 2202 determines whether audio prompting is performed to regulate the 
physiological movement. Control portion 2204 determines whether the inhale and exhale 

20 periods for patient feedback is manually or automatically set. If the inhale and exhale 
periods are manually set, then the inhale/exhale period values shown in control portion 
2206 are manually configured. If the inhale and exhale periods are automatically set, then 
these periods are automatically determined, e.g., using the process shown in Fig. 13b. In 
this case the control portion 2206 is used to increment or decrement the automatically 

25 sensed inhale and exhale periods before using them to prompt the patient. This, for 
example, is used to encourage the patient to breathe more slowly than he or she would 
normally breath. 

Fig. 23 shows an interface window for controlling the visual feedback used to limit 
the motion range for the physiological movement. A control portion 2302 determines 
30 whether the motion range is manually or automatically set. If the motion range is 
manually set, then the motion range value shown in control portion 2304 is manually 
configured. Otherwise, the control portion 2304 is automatically configured, e.g., based 
upon the sensed motion range for the marker block. 
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Fig. 24 shows a screenshot of a display window according to an embodiment of the 
invention. A first portion of the display window shows the sliders of Fig. 16 quantifying 
real-time motion of the marker block. A second portion of the display window shows the 
control interface of Fig. 20. A third portion of the display window shows a real-time 
5 image of the patient as seen through the video camera. 

Computer System Architecture 

Figure 12 is a block diagram that illustrates an embodiment of a computer system 
1900 upon which an embodiment of the invention may be implemented. Computer system 

10 1 900 includes a bus 1 902 or other communication mechanism for communicating 
information, and a processor 1904 coupled with bus 1 902 for processing information. 
Computer system 1900 also includes a main memory 1906, such as a random access 
memory (RAM) or other dynamic storage device, coupled to bus 1902 for storing 
information and instructions to be executed by processor 1904. Main memory 1906 also 

1 5 may be used for storing temporary variables or other intermediate information during 
execution of instructions to be executed by processor 1904. Computer system 1900 
further includes a read only memory (ROM) 1908 or other static storage device coupled to 
bus 1902 for storing static information and instructions for processor 1904. A data storage 
device 1910, such as a magnetic disk or optical disk, is provided and coupled to bus 1902 

20 . for storing information and instructions. 

Computer system 1900 may be coupled via bus 1902 to a display 1912, such as a 
cathode ray tube (CRT), for displaying information to a user. An input device 1914, 
including alphanumeric and other keys, is coupled to bus 1902 for communicating 
information and command selections to processor 1904. Another type of user input device 

25 is cursor control 1916, such as a mouse, a trackball, or cursor direction keys for 

communicating direction information and command selections to processor 1904 and for 
controlling cursor movement on display 1912. This input device typically has two degrees 
of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the 
device to specify positions in a plane. 

30 The invention is related to the use of computer system 1900 for detecting and 

predictively estimating physiological cycles. According to one embodiment of the 

invention, such use is provided by computer system 1900 in response to processor 1904 

executing one or more sequences of one or more instructions contained in main memory 
39 
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1 906. Such instructions may be read into main memory 1906 from another computer- 
readable medium, such as storage device 1910. Execution of the sequences of instructions 
contained in main memory 1906 causes processor 1904 to perform the process steps 
described herein. One or more processors in a multi-processing arrangement may also be 
5 employed to execute the sequences of instructions contained in main memory 1906. In 
alternative embodiments, hard-wired circuitry may be used in place of or in combination 
with software instructions to implement the invention. Thus, embodiments of the 
invention are not limited to any specific combination of hardware circuitry and software. 
The term "computer-readable medium" as used herein refers to any medium that 

10 participates in providing instructions to processor 1904 for execution. Such a medium 

may take many forms, including but not limited to, non-volatile media, volatile media, and 
transmission media. Non-volatile media includes, for example, optical or magnetic disks, 
such as storage device 1910. Volatile media includes dynamic memory, such as main 
memory 1906. Transmission media includes coaxial cables, copper wire and fiber optics, 

1 5 including the wires that comprise bus 1 902. Transmission media can also take the form of 
acoustic or fight waves, such as those generated during radio wave and infrared data 
communications . 

Common forms of computer-readable media include, for example, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any 
20 other optical medium, punch cards, paper tape, any other physical medium with patterns of 
holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or 
cartridge, a carrier wave as described hereinafter, or any other medium from which a 
computer can read. 

Various forms of computer readable media may be involved in carrying one or 
25 more sequences of one or more instructions to processor 1904 for execution. For example, 
the instructions may initially be carried on a magnetic disk of a remote computer. The 
remote computer can load the instructions into its dynamic memory and send the 
instructions over a telephone line using a modem. A modem local to computer system 
1900 can receive the data on the telephone line and use an infrared transmitter to convert 
30 the data to an infrared signal. An infrared detector coupled to bus 1902 can receive the 
data carried in the infrared signal and place the data on bus 1902. Bus 1902 carries the 
data to main memory 1906, from which processor 1904 retrieves and executes the 
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instructions. The instructions received by main memory 1906 may optionally be stored on 
storage device 1910 either before or after execution by processor 1904. 

Computer system 1900 also includes a communication interface 1918 coupled to 
bus 1902. Communication interface 1918 provides a two-way data communication 
5 coupling to a network link 1920 that is connected to a local network 1922. For example, 
communication interface 1918 maybe an integrated services digital network (ISDN) card 
or a modem to provide a data communication connection to a corresponding type of 
telephone line. As another example, communication interface 1918 maybe a local area 
network (LAN) card to provide a data communication connection to a compatible LAN. 

1 0 Wireless links may also be implemented. In any such implementation, communication 
interface 1918 sends and receives electrical, electromagnetic or optical signals that carry 
data streams representing various types of information. 

Network link 1920 typically provides data communication through one or more 
networks to other devices. For example, network link 1920 may provide a connection 

1 5 through local network 1922 to a host computer 1924 or to medical equipment 1 926 such as 
a radiation beam source or a switch operatively coupled to a radiation beam source. The 
data streams transported over network link 1920 can comprise electrical, electromagnetic 
or optical signals. The signals through the various networks and the signals on network 
link 1920 and through communication interface 1918, which carry data to and from 

20 computer system 1900, are exemplary forms of carrier waves transporting the information. 
Computer system 1900 can send messages and receive data, including program code, 
through the network(s), network link 1920 and communication interface 1918. 

In the foregoing specification, the invention has been described with reference to 
25 specific embodiments thereof. It will, however, be evident that various modifications and 
changes may be made thereto without departing from the broader spirit and scope of the 
invention. For example, the operations performed by computer 110 can be performed by 
any combination of hardware and software within the scope of the invention, and should 
not be limited to particular embodiments comprising a particular definition of "computer". 
30 The specification and drawings are, accordingly, to be regarded in an illustrative rather 
than restrictive sense. 
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1 . A method of gating radiation for a computed tomography procedure, comprising: 
measuring a first set of signal data representative of a physiological movement of a 

5 patient during a first time period; 

pattern matohing the first set of signal data with a second set of signal data related 
to measured physiological movement of a patient during a second time period to identify 
degree of deviation from periodicity of the physiological movement; and 

gating radiation to the patient if the degree of deviation from periodicity exceeds a 
1 0 threshold based upon results of the pattern matching. 

2. The method of claim 1 in which the first set of signal data and the second set of 
signal data are pattern matched using an autocorrelation function. 

15 3 . The method of claim 1 in which the first set of signal data and the second set of 
signal data are pattern matched using an absolute difference function. 

4. The method of claim 1 further comprising: 

determining a degree of match between the first set of signal data and the second 
20 set of signal data. 

5 . The method of claim 4 in which the degree of match is determined by a secondary 
peak value of an autocorrelation function. 

25 6. The method of claim 4 in which the degree of match is determined by a secondary 
minimum value of an absolute difference function. 

7. The method of claim 4 further comprising: 
comparing the degree of match to a threshold range. 

30 

8. The method of claim 7 in which the degree of match outside the threshold range 
indicates deviation from a normal physiological movement. 
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9. The method of claim 7 in which the degree of match within the threshold range 
indicates a repetitive physiological movement. 



10. The method of claim 9 in which a point of best match indicates a period of the 
5 physiological movement. 

1 1 . The method of claim 1 further comprising: 

predicting a period of the physiological movement during a third time period. 

10 12. The method of claim 1 1 further comprising: 

predictively actuating a gating system component based upon the predicted period. 

13. The method of claim 1 further comprising: 
determining a period of the physiological movement. 

15 

14. The method of claim 1 3 further comprising; 

defining a treatment interval to apply radiation to a patient. 

15. The method of claim 14 in which the treatment interval is defined by phase of the 
20 physiological movement. 

16. The method of claim 1 in which the second set of signal data is a data model of the 
physiological movement of the patient. 

25 17. A method for physiological gating comprising: 

determining a period of physiological movement; 

physiological gating in an interval range based upon phase of the period of the 
physiological movement. 

30 18. The method of claim 1 7 in which the period of physiological movement is 
determined by pattern matching a first set of data representative of the physiological 
movement during a first time period with a second set of data related to the physiological 
movement during a second time period. 
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19. The method of claim 1 8 in which the first set of data and the second set of data are 
pattern matched using an autocorrelation function. 

5 20. The method of claim 1 8 in which the first set of data and the second set of data are 
pattern matched using an absolute difference function. 

21 . A method of gating radiation for a computed tomography procedure, comprising: 
determining a period of periodic physiological movement; 

10 determining an amount of time required to actuate a gating component for a 

computed tomography radiation device; 

defining an interval range for applying radiation, the interval range defined over a 
portion of the period of the periodic physiological movement; and 

predictively actuating the gating component to compensate for the amount of time 
1 5 required to actuate the gating component. 

22. The method of claim 2 1 in which said gating component is a switch operatively 
coupled to a radiation source. 

20 23. The method of claim 21 further comprising: 

predicting a next period of physiological movement. 

24. The method of claim 23 in which the interval range is defined over the 
physiological movement. 

25 

25. The method of claim 24 in which the gating component is predictively actuated to 
coincide the full actuation of the gating component with a boundary of the interval range. 

26 . A method of gating the application of radiation for a CT procedure, comprising: 
30 measuring signal data representative of at least a portion of a physiological 

movement to form a set of ordered measurement samples; 
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pattern matching the set of ordered measurement samples against prior 
measurement samples of the physiological movement to determine deviation from 
periodicity of the set of ordered measurement samples; and 

gating CT radiation to the patient if the deviation from periodicity is outside a 
5 threshold range. 

27. The method of claim 26 in which the second set of ordered measurement samples 
overlaps with the prior measurement samples. 

10 28 . The method of claim 26 in which the step of pattern matching comprises shifting 
the set of ordered measurement samples against the prior measurement samples at a 
plurality of offset sample positions to determine position of best match. 

29. The method of claim 28 in which an absolute difference function is used to 
15 determine the position of best match. 

30. The method of claim 26 further comprising: 

determining a predicted value for an additional measurement sample for the 
physiological movement. 

20 

3 1 . The method of claim 30 in which radiation gating occurs if the predicted value 
deviates from the additional measurement sample beyond a designated threshold level. 

32. The method of claim 28 in which a search range for position of best match is 

25 established based upon a predicted position, in which the predicted position is based upon 
a period established from the prior measurement samples. 

33. The method of claim 26 in which the physiological movement comprises breathing 
movement. 

30 

34 . The method of claim 26 in which pattern matching is performed using an 
autocorrelation function 
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3 5 . The method of claim 26 in which pattern matching is performed using an absolute 
difference function. 



36. The method of claim 26 further comprising; 

5 defining an interval range to apply radiation to a patient. 

37. The method of claim 36 in which the interval range is defined based upon phase of 
the physiological movement. 

10 38. A method of gating radiation, comprising: 

receiving a set of signal data representative of a physiological movement of a 

patient; 

estimating phase of the set of signal data; 

comparing a vector of the set of signal data with one or. more prior sets of signal 
15 data to identify deviation from periodicity of the physiological movement, the vector of 
the set of signal data based upon the phase, the one or more prior sets relating to measured 
physiological movement of a patient during one or more prior time periods; and 

gating radiation to the patient if the deviation from periodicity is identified. 

20 39. The method of claim 3 8 in which the phase is estimated by calculating period of 
the set of signal data. 

40. The method of claim 39 further comprising 

computing an inner product of a Cosine waveform with the period T and most 
25 recent T-seconds-long segment of the signal data to form an in-phase component; 

computing the inner product with a Sine waveform of the period T to form a 
quadrature component; and 

computing the inverse Tangent of result of dividing the quadrature component by 
the in-phase component to estimate the phase. 

30 

41 . The method of claim 39 further comprising: 

identifying an assumption for the period; 

estimate location values for maximum and miTiirmim values; and 
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based upon one or more sample sets, estimating the period. 



42. The method of claim 3 8 in which the vector comprises amplitude and phase 
components. 

5 

43. The method of claim 38 in which the act of comparing the vector of the set of 
signal data with the one or more prior sets of signal data to identify deviation from 
periodicity of the physiological movement comprises: 

using a 2-dimensional histogram array of signal versus phase values. 

10 

44. The method of claim 43 in which the 2-dimensional histogram array is 
accumulated during prior recordings of the physiological movement. 

45. The method of claim 43 further comprising: 

1 5 comparing the vector against with other values in the 2-dimensional histogram 

array; 

forming a clustering factor; and 

identifying deviation from periodicity if clustering factor exceeds a threshold. 

20 46. The method of claim 38 in which the physiological movement comprises 
respiration activity. 

47. The method of claim 46 further comprising: 

estimating latest inhale values, latest exhale extreme values, and corresponding 
25 time points. 

48. The method of claim 38 in which the radiation comprises therapeutic radiation. 

49. The method of claim 38 in which the radiation relates to a CT procedure. 

30 

50. A method for gating a medical procedure, comprising: 

collecting data samples for a physiological activity, 

analyzing the data samples to identify deviation from periodicity; and 
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gating the medical procedure if deviation from periodicity is identified. 

5 1 . The method of claim 50 in which the act of gating the medical procedure 
comprises gating the application of radiation. 

5 

52. The method of claim 51 in which the medical procedure comprises a computed 
tomography procedure. 

10 53. The method of claim 51 in which the medical procedure comprises a radiotherapy 
procedure. 

54. The method of claim 50 in which the act of gating the medical procedure 
comprises gating of data acquisition. 

15 

55 . The method of claim 54 in which gating of data acquisition comprises binning 
data. 

56. The method of claim 54 in which the medical procedure comprises an emission 
20 imaging method. 

57. The method of claim 56 in which the emission imaging method comprises an MRI 
procedure. 

25 58. The method of claim 56 in which the emission imaging method comprises a PET 
procedure. 

59. The method of claim 50 in which gating is performed retrospectively. 

30 60. A method for physiological gating, comprising: 

co-locating a marker block with a patient, the marker block comprising two or 

more markers; 

viewing the marker block with a camera; 
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generating image data representative of the marker block; and 
gating based upon the image data. 



61 . The method of claim 60 in which the marker block comprises two markers. 

5 

62. The method of claim 61 in which the marker block is positioned such that the two 
markers are both simultaneously viewed by the camera. 

63. The method of claim 61 in which positions of the two or more markers are tracked 
10 using the image data. 

64. The method of claim 60 further comprising: 
quantifying movement for the marker block. 

15 65 . The method of claim 64 in which a range interval for gating is based upon the 
movement of the marker block. 

66. The method of claim 65 in which gating is performed based upon amplitude of 
movement data. 

20 

67. The method of claim 65 in which gating is performed based upon deviation from 
periodicity of the movement data. 

68 . The method of claim 64 further comprising: 

25 identifying physical distance between the two or more markers; and 

determining a scale factor using the physical distance, the scale factor used for 
transforming incremental motion of the marker block viewed by the camera into the 
physical domain; 

30 69. A method for gating a computed tomography procedure, comprising: 
directing a camera at a patient; 
viewing physiological movement by the patient; 

generating image data representative of the physiological movement by the patient; 
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analyzing the image data against an established range interval for applying 
radiation; and 

gating radiation to the patient based upon analysis of the image data. 

5 70. The method of claim 69 further comprising: 

co-locating a marker block with the patient, wherein movement of the marker 
block is measured to determine the physiological movement of the patient. 

7 1 . The method of claim 70 in which the marker block comprises two or more 

10 



72. The method of claim 69 further comprising: 
predictively actuating a gating component. 

15 73. The method of claim 69 in which gating is performed based upon deviation from 
periodicity of the movement data. 

74. The method of claim 69 in which gating is performed based upon movement signal 
data exceeding a threshold in the range interval. 

20 

75 . The method of claim 69 in which gating is performed based upon phase of the 
physiological movement. 

76. A system for patient positioning, comprising: 

25 a marker block having a plurality of identified landmarks; 

one optical camera positioned to view the marker block; and 
a computing device to calculate position and orientation of the marker block based 
upon viewed location of the identified landmarks by the one optical camera. 

30 77. A method for identifying position of a patient, comprising: 

co-locating a marker block with a patient, the marker block having a plurality of 

identified landmarks; 

viewing the marker block with a single camera; 
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produce image coordinates for the identified landmarks viewed by the single 
camera; 

comparing the image coordinates with reference coordinates for the landmarks; 
and 

determining the position and orientation of the patient; 

78. An interface for prompting a patient in a physiological activity, comprising: 

a computer-generated image configured to show visual real-time feedback for the 
physiological activity; 

the computer-generated image configured to show a desired range for the 
physiological activity; and 

the computer-generated image simultaneously showing the desired range and the 
visual real-time feedback to prompt maintenance of the physiological activity 
within the desired range. 

79. An interface for prompting a patient in a physiological activity, comprising: 

a computer-generated image configured to show visual real-time feedback for the 
physiological activity; 

the computer-generated image configured to show a desired range for the 
physiological activity; and 

computer-generated verbal prompting to instruct maintenance of the physiological 
activity within the desired range. 
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